Achieving Intercoder Reliability with a Taxonomy of Speech Acts
نویسنده
چکیده
This paper presents 1) a means of developing a decision procedure to help human taggers label utterances with speech acts, signiicantly increasing the chances of achieving intercoder reliability, and 2) a principled method for selecting a set of speech acts that successfully addresses a tradeoo between distinguishable speech acts at a high level of abstraction and informative speech acts at a low level of abstraction.
منابع مشابه
Behaviour change techniques: the development and evaluation of a taxonomic method for reporting and describing behaviour change interventions (a suite of five studies involving consensus methods, randomised controlled trials and analysis of qualitative data).
BACKGROUND Meeting global health challenges requires effective behaviour change interventions (BCIs). This depends on advancing the science of behaviour change which, in turn, depends on accurate intervention reporting. Current reporting often lacks detail, preventing accurate replication and implementation. Recent developments have specified intervention content into behaviour change technique...
متن کاملProblems for Reliable Discourse Coding Systems
Focusing on issues of intercoder reliability, this paper describes problems experienced in designing coding systems that classify language using discourse-relevant categories. First, given the absence of a consensus among language scholars, we examine options for selecting and structuring code categories, particularly those which have an impact on intercoder reliability. We observe that compute...
متن کاملIntercoder reliability in annotating complex disfluencies
In previous work, we presented an annotation scheme that can describe complex disfluencies. In this paper, we first show the prevalence of complex disfluencies and illustrate the types of distinctions that our scheme allows. Second, we present an annotation tool that allows the scheme to be easily applied. Third, we present the results of a reliability study in annotating complex disfluencies w...
متن کاملAssessing Language Learners’ Knowledge of Speech Acts: A Test Validation Study
Veryfew attempts have been made in the past to develop instruments to measure pragmatic knowledge of second language (L2) learners. The absence of such instruments in the literature of English language teaching (ELT) underscores the need for the researchers to develop new tests that are specifically designed to assess this crucial but less explored aspect of language learners’ (LLs) knowledge. ...
متن کاملImpact of Teacher Motivational Practice on Iranian EFL Learners’ Request and Refusal Speech Acts Production
The purpose of the study was to examine how teacher motivational practice might influence Iranian EFL Learners’ Request and Refusal Speech Acts Production. To this end, five instruments were used to provide appropriate responses to research questions: (a) Quick Placement Test (b) the Motivational Orientation of Language Teaching classroom observation scheme, (c) the Post-Lesson Teacher Evaluati...
متن کامل